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^ | | Abstract 

\Q \ We study a problem of optimal investment / consumption over an infinite horizon in a 

market consisting of a liquid and an illiquid asset. The liquid asset is observed and 
can be traded continuously, while the illiquid one can only be traded and observed at 
discrete random times corresponding to the jumps of a Poisson process. The problem is 
a nonstandard mixed discrete/continuous optimal control problem which we face by the 
dynamic programming approach. The main aim of the paper is to prove that the value 
function is the unique viscosity solution of an associated HJB equation. We then use 
such result to build a numerical algorithm allowing to approximate the value function 
and so to measure the cost of illiquidity. 
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1 Introduction 



We study a problem of optimal investment / consumption over an infinite horizon in a market 
consisting of a liquid and an illiquid asset. The liquid asset is observed and can be traded 
continuously, while the illiquid one can only be traded and observed at discrete random 
times corresponding to the jumps of a Poisson process with intensity A > 0. 

This kind of model for the illiquid asset has been already proposed in the literature, 
e.g. in the papers EJ [10], which deal just with an illiquid asset. Within this setting, 
the paper [T] introduces in the market model also a liquid asset correlated with the illiquid 
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oneo However, in the latter paper it is assumed full information on the state of the illiquid 
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1 



asset, differently from [8] where the illiquid asset can be observed only at the trading dates. 
Here we consider the point of view of [8], which seems more realistic, and assume that 
the illiquid asset can be only observed at the trading dates. Another main difference with 
respect to pQ is that here we consider general utility, so we cannot perform a reduction of 
variable by homogeneity, which in pQ is allowed by the choice of CRRA utility. 

In Section 2, we set the problem as a mixed discrete/continuous stochastic optimal con- 
trol problem. Such a problem is not standard in the theory of optimal stochastic control. 
Thus, in Section 3 - following the approach of [8] - by means of a specific dynamic pro- 
gramming principle we reduce the control problem between trading times to a continuous 
time-inhomogeneous problem. Then we state the main result of the paper (Theorem 13. ip . 
providing the characterization of the value function of the reduced problem as unique con- 
tinuous viscosity solution of the associated Hamilton-Jacobi-Bellman (HJB) equation. This 
result allows us to perform in Section 4 a numerical iterative scheme to approximate the 
value function, which is not straighforward due to the presence of a nonlocal term in the 
HJB equation. In Section 5 we exploit the results obtained providing some first answers to 
the problem: we describe the structure of the optimal allocation policy in the illiquid asset 
and give a numerical measure of the cost of illiquidity. 

In order to go further into the solution and state the optimal allocation in the liquid 
asset as well as the optimal consumption rate, one has to prove regularity results for the 
value function. These results are the object, in the case of power utility, of the companion 
paper where more numerical tests are performed. 

2 Market model and optimization problem 

Let us consider a complete filtered probability space (Q, F, (J r t)t>o,P) satisfying the usual 
conditions, on which there are defined: 

- A Poisson process (Nt)t>o, with intensity A > 0; we denote by (Aft)t>o the filtration 
generated by this process and by {r n ) n >\ its jump times; moreover we set tq = 0. 

- Two independent standard Brownian motions (B t )t>o and (Wt^o, independent also 
of the Poisson process (N t )t>o; we denote by (Bt)t>o and (Wt)t>o the filtration gen- 
erated by B and W respectively. 

The market model we consider on this probability space is composed by a riskless asset 
with constant return rate, which for sake of simplicity we consider equal to 0, and two risky 
assets with correlation p £ (—1,1): 

- A liquid risky asset that can be traded continuously; it is described by a stochastic 
process denoted by L t whose dynamics is 

dL t = b L L t dt + a L L t dW t , 

where 6^ £ 1 and cjl > 0. 
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- An illiquid risky asset that can only be traded at the trading times r n ; it is described 
by a stochastic process denoted by It, whose dynamics is 

dl t = biltdt + ail t (pdW t + \A - P 2 dB t ^j , 
where bi G K and a/ > 0. 
Without loss of generality we assume Lq = Iq = 1. Define the u-algebra 

Xt = a(l Tn l {TnSt} , n>0), t>0. 
Moreover define the filtration 

G° = (G?)t>o; Qt = MtVl t VWt = a(r n ,I Tn ;T n <i)VW t . 

The observation filtration we consider is 

G = (&)t> ; ft = a t ° V a(P-null sets). 

This means that at time t the agent knows the past of the liquid asset up to time t, the 
trading dates of the illiquid assets occurred before t, and the values of the illiquid asset at 
such trading dates. 

In the setting above, we define a set of admissible trading/consumption strategies in the 
following way. Consider all the triplets of processes (ct,ir t ,ak) such that: 

(hi) c = (ct)t>o is a continuous-time nonnegative process (ft)t>o-predictable and with 
locally integrable trajectories; q represents the consumption rate at time t. 

(h2) 7r = (iTt)t>o is a continuous-time process (ft)t>o-predictable with locally square inte- 
grable trajectories; 7Tj represents the amount of money invested in the liquid asset at 
time t. 

(h3) a = (afc)fceNj is a discrete-time process, where a& is Q Tk -measurable; a& represents 
the amount of money invested in the illiquid asset in the interval (Tfc,rfc + i]. 

Given a triplet (c, ir, a) satisfying the requirements (hl)-(h3) above and an initial wealth 
r > 0, we can consider the process Rt representing the wealth associated to such strategy. 
Its dynamics can be defined by recursion on k > by 

R = r, 

R t = Rr k + J (-c s ds + -a s (b L ds + a L dW s )) + a k - lj , t e {r k ,T k+1 \. 

As a class of admissible controls we consider all the triplets of processes (c, ir, a) satisfy- 
ing the measurability and integrability conditions above and such that the corresponding 
wealth process Rt is nonnegative (no-bankruptcy constraint). The class of admissible con- 
trols depends on the initial wealth Rq = r. We denote this class by A(r), noticing that it 
is not empty for every r > 0, as (0, 0, 0) £ A(r). 
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Given a utility function U : R+ — > R, the optimization problem we want to solve is 



Maximize E 



oo 

e- pa U{c a )da 



o 



over (c, 7r, a) G.A(r). (1) 



Assumption 2.1 XTie utility function U is continuous, nondecreasing, concave and bounded 
from below (without loss of generality we assume that U(0) = 0). Moreover, it satisfies the 
growth condition, for some Kjj > 0, 

U(c) < K uC p. (2) 

Assumption 2.2 We assume that 

P > kp, (3) 

where 

k p := sup \p(u L b L + uibi) - P 1 P ' (u 2 L a 2 L + ujaj + 2pu L uia L ai) X . 

Ui6R,«i6[0,l] I 2 J 

For convenience we set 

fcp := sup <^ p(bi )uj 07 (1 - p^uji. 

«I6[0,1] I °"i ^ J 

so that 

p " 2(l-p)o£ +V 

Remark 2.1 T/ie assumption on (3 is related to the investment/consumption problem with 
the same assets but in a liquid market. Let p £ (0, 1) and consider an agent with initial 
wealth r, consuming at rate Ct and investing in Lt and It continuously with respective 
proportions u\ and u\ and under the constraint that u\ G [0, 1] . Suppose, moreover, that 
the preferences of the agent are represented by the utility function U^ p \c) = c p /p, with 
p £ (0, 1). Let us denote by AMert( r ) the set of strategies keeping the wealth nonnegative 
and define the value function 



vfirtto = sup E 



00 

e" 







(4) 



This is a constrained Merton problem which dominates our problem, in the sense that 
vj^l Jr) is higher of the optimal value of our problem, up to the multiplicative constant Ku 
of ([2]). One can see (for instance by solving the HJB equation) that V^\ rt is finite if and 
only if ([3]) is satisfied and that in this case 



Therefore, condition (|3|) guarantees together with ([2]) finiteness for our problem too. 
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3 Dynamic programming and HJB equation 

Let us denote by V the value function of the stochastic control problem ([I]): 



V(r) = sup IE 

(c,TT,a)€A(r) 



oo 

e- ps U{c s )ds 



Proposition 3.1 V is everywhere finite, concave, p-Holder continuous and nondecreasing. 
Moreover 

V(r) < K v r p , for some K v > 0. (6) 

Proof. As we have already observed in Remark 12. 1\ finiteness and ([6]) follow from ([2]) and 
([3j) , by comparing with a constrained Merton problem. 

Concavity of V comes from concavity of U and linearity of the state equation by stan- 
dards arguments. Also monotonicity is consequence of standard arguments due to mono- 
tonicity of U. Finally, p-Holder continuity follows from concavity and monotonicity of V, 
and from (0). □ 

Following [8], we state a suitable Dynamic Programming Principle (DPP) to reduce our 
mixed discrete/continuous problem to a standard one between two trading times. 

Proposition 3.2 (DPP) We have the following equality: 



V(r) = sup E 



Tl 



e~P s U(c s )ds + e~P T1 V (R T1 ) 



o 



(7) 



Proof. The proof is long and technical, but similar to the one in [9] and we omit it for 
brevity. Note however that, unlike in [9], there is some additional information between 
and T\ brought by W, so the "shifting" procedure is slightly more technical to achieve. One 
can see, for instance, Appendix B in [5] for details on the shifting procedure when there is 
a random process bringing an extra information between and t\. □ 

We can use this DPP to relate our original problem into a standard continuous-time control 
problem. First of all, letting 7W(M+;1R) denote the space of measurable functions from R + 
to M, we define the linear operator 

R + ;R) 

^ G[m^,y) :=E[i;(x + yJ t )}, 



G : M(R+;R) — > A4([0,+oo) x Ri ;R) 



where 



= ( h I ~ P h L—) dt + a iy /l - fPdB t , J = 1. 



(9) 



For each x > and t > 0, let At(x) be the set of couples of stochastic processes (c s ,Tr s ) s >t 
such that 
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- (c s ) s >t is (W s ) s >t-predictable, nonnegative and has locally integrable trajectories; 

- (vr s ) s >( is (W s ) s >j-predictable and has locally square integrable trajectories; 

- x + ff(-c s ds + TT s (b L ds + a L dW s )) > 0, for all T > t. 
Using ([7]), one can show (see [I]) that 

V(r) = sup V(0,r-a,a), r > 0, (10) 

0<a<r 

where 

V{t,x,y) = sup J(t,x,y;c,ir), (t, x, y) G R+, (11) 

(c,7r)eA(a:) 

and 

/oo 

with (Xs ,:r ' c,7r ) s >t, (Ys' v ) s >t solutions to the SDEs 

dX s = —c s ds + 7r s (bLds + (JLdW s ), X t ' x ' c '™ = x, (13) 
dY s = pY s (j^-dt + ajdWs^j , = y. (14) 

We notice that the problem of optimizing the functional above is not autonomous due to 
the dependence of G[V] on time. 

Associating to every locally bounded function v : R5. — > R the function T~Lv : R — > R 
defined by 

\Hv\{r) = sup -0(0, r — a, a), 

0<a<r 

by the arguments above we may rewrite the original problem as 

V{r) = [HV](r). (15) 

The problems (jlip and (|15|) are coupled in the sense that V is expressed in terms of V in 
(fTT|) and, viceversa, V can be expressed in terms of V by (fT5|) . 

3.1 Properties of V 

In this subsection we prove some qualitative properties of the value function V. First, we 
start by studying some properties of the operator G. 

Proposition 3.3 

(i) G is well defined on the set of measurable functions with polynomial growth. 

(ii) G is positive, in the sense that it maps positive functions into positive ones. 
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(Hi) G maps increasing functions to functions which are increasing with respect to both x 
and y. 

(iv) G maps concave functions to functions which are concave with respect to (x,y). 

(v) Ifip(r) = r p , p £ (0, 1), then 

< G[ip](t,x,y) < e^ix + yf, Vi > 0, V(x, y) G (16) 

(vi) Let p G (0, 1] and ip a p-Holder continuous function. Then there exists some constant 
C > such that for all t > 0, x, x',y, y' > 0, and < h < 1, 

|GM(t,z,y)-GM(t,x',y)| < C\x-x'f, (17) 

\G[TP](t,x,y)-G[m,x,y')\ < Ce^ly-yT, (18) 
\G[4>](t,x,y)-G[m + h,x,y)\ < Ce^hP/ 2 , (19) 

Proof, (i)-(iv) are straightforward. 

(v) . If x = y = the claim is obvious, so we assume x + y > 0. By a straightforward 
application of Ito's formula and the definition of k p , we see that (e~ kpt (x + yJt) p )t>o ls a 
supermartingale, which implies (|16p , 

(vi) . (JTTj) is obvious, and (fT8|) follows directly from (v). To prove (fT9j) . fix (i, y) G 
and /i € (0, 1]. We can write for some C > 

|GM(*,a^)-GM(* + M,i/)| < Cy p E[\J t - J t+h \*>] 

= Cy p E[\J t m[\l-J h \P] (20) 
< Ge^VE[|l- J h \ p }. 

Now we have Jh = e aft+ ^ v ^ Ar , where a, (3 are constants and where N ~ A/"(0, 1). Since 
|e ? - 1| < |f | (e ? + 1) for all £ G K, we obtain for some Gi > 



K[\l-J h \P 



< E 



aVh + pN) p (e ah+(3V * N + 1)H < Gi, for < h < 1. (21) 



The claim follows combining (I2ip with (|20p . □ 
Lemma 3.1 For (t,x,y) G (c,7r) G A 0*0, P G (0,1), 

E [pT^' c ' w + y a *-f)P] < e^^^V + yf, Vs > t. (22) 

Proof. Fix (t,x,y) G and (c,7r) G ^4j(x). First of all we notice that by standard 
comparison of SDE's we have 

J£t,X,C,1T ^ J^t,X,0,7T (23) 

On the other hand we have 

d(X$ xfl >* + 



U s {b L ds + a L dW s 
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where 



j^t,X,0,7T _|_ yt,y ' 



Noticing that jt^-^t = sup ueR ^pbiu — p<k1 2 ^ cr|-u 2 j, it is then a straightforward appli- 
cation of Ito's formula to check that (exp(— jz^^r{ s ~ t))(Xt' x ' 0,7T + Ys ,y ) p> \ is a local 



'l / s>t 

supermartingale, and, being nonnegative, a true supermartingale. Therefore, we have the 
claim for c = 0. The general claim follows from (|23p . □ 

Proposition 3.4 V(t, •) is concave with repect to (x,y) and nondecreasing with respect to 
x and y for every t > 0. Moreover it satisfies the boundary condition 

roo 

V(t,0,y) = E J e-^ +x ^ s ~^\G[V}(s,0,Y^y)ds, Vt > 0, Vy > 0. (24) 

In particular, since by Assumption \2. 1\ it is £7(0) = 0, due to Proposition \3. 3\( v) we have 

V(t,0,0) = 0, Vt>0. (25) 
Finally, V is continuous on M^_, and satisfies for some > the growth condition 

< V(t,x,y) < K 9 e^\x + yf, V(t,x,y) eR%. (26) 

Proof. Concavity and monotonicity. Since V is concave and nondecreasing, by Propo- 
sition (3J3|ni, iv), G[V](i, •) is concave in (x,y) and nondecreasing in x,y on Then 
concavity and monotonicity of V follow by standard arguments, considering also the lin- 
earity of the SDE's (jl3> ([T3 ]) . 

Boundary condition. Equality (f24"|) is due to the fact that At(0) = {(0,0)}, so 

/oo 
e -V+W-t)xG\y](s,0,Y2' v )ds. 

Continuity. We prove the continuity of V in several steps. 

1) Continuity of V(t, •) in (0, +oo) 2 follows from concavity. 

2) Here we prove the continuity of V(t,-,y) at x = + . First of all notice that (|24p 
holds at x = 0, so using monotonicity of V and l3.3t -(iii) we get 

< J(t,x,y;0,0) - J(t,x,0;0,0) < V(t, x, y) - V(t, x, 0). (27) 

On the other hand, using Holder continuity of V and (|17[) . we have for some K > and all 
(c,7r) G A t {x) 

J(t,x,y,c,ir) - V(t,0,y) 
< E 



it 

roo 

< E ' 



/oo 
e -(p+X)(s-t) j^^) + x\G[V](s,Xl^ c ' n ,Y s t,V ) - G[V](s,0,Y s t,V )\} ds 

/oo 
e -{l3+\)(s-t) p( c j + K \xl> x > c >*\P) ds 



s 



Taking the supremum over (c, tt) G At(x) and combining with (|27p we get 



< - V(t,0,y) < sup E 



-(j3+\)(s-t) 



.(28) 



We have to estimate the right handside of ()28|) . By definition of At(x), we have 

dL„ 



X 



t,X,C,1T 



X+ TT U 



L 



u Jt 



c u du. 



(29) 



Denoting by Q the probability with density process given by Z t = exp ( —-^rt —Wt i , 

L is a (Q^-martingale. The process X t,a: ' c ' 7r is then a Q^-local supermartingale and, being 
bounded from below, it is a true Q L -supermartingale. Hence, we have E[Z s Xs' x ' c,7r ] < x. 
Now, writing ix^' ' 71 ^ = \Z s Xt' x ' c,7T \ p Z^ p , by Holder's inequality we get 



EOX^'T] < E[2 s I s t,I ' c 'TE[^ H f" f < x p exp 



1 - p 2a 2 r 



(30) 



Note also that, since e (p+*)C s t >U(c s )ds is the utility obtained by the agent trading 
only in L, we have by ([6]) 



sup E 



/CO 
e -W+V(s~t) U{Cs)ds 



< V(x) < K v x* 



Combining (f28|) . ([3"D"j) . ([31~]) . and using ©, we get for some if > 

< V(t,x,y)-V(t,0,y) < KxP, 



(31) 



(32) 



and we conclude. 

3) Here we prove the continuity of V(t,x, •) at y = + . Using monotonicity of V and 
Proposition I3.3( iii) we get 



< J(t, x, y; c, 7r) - J(t, x, 0; c, tt) 



(33) 



On the other hand, using Holder continuity of V, (|18p and (|22p . we have for some K > 
and for all (c, 7r) G ^4t(x) 

/■CO 

J{t,x,y;c,7r) -J(t,x,0;c,n) < Ke kpt e -{p+\-k p ){s-t) XE[(Y*> y ) p ]ds 



(34) 



A 



P + A - fc p 



e kpt y p . 



Therefore, taking the supremum over (c, 7r) G *4t(a;) in (|34|) and combining with (|33|) . we 

get 



< V^.s.y) - V(t,x,0) < 



KA 



l3 + X-k p 



(35) 



9 



and we conclude. 

4) Since (|35p and (|32p are uniform estimates in x, y respectively, combining with the 
continuity on the lines provided by items 2) and 3), we get the joint continuity of V with 
repect to (x,y) at the boundary {(x,y) G | x = or y = 0}. 

5) Here we prove p/2-H61der continuity of V(-,x,y). Let t, t' > and suppose that 
t' = t + h for some < /i < 1. One can associate to each (c*,7r*) s > t G ^(x) a control 
(c* , 7T* ) s >t/ G ^4f(x) with the same law and viceversa (see |12|. Th. 2.10, Ch. 1]). Given that 
and considering f)19|) and (|22p . we have for some K > 



x, y, c*, 7T*) - ^(i', x, y, / , vr'^ 



e -(/3+A)( S -t) A G [y]( S) x i ' x ' ct '"\y^)rfs-G[y](s + /i,x t ' :r ' ct '" t ,y s t ' y ; 

/"OO 



r/.s 



/3 + A - fc p 

Passing to the supremum over (c*,7r*) s >t G -4.t(x) (respectively over (c* ,7r* ) s > t / G ^(x)), 
we get for some K > 

|F(t > x > j/)-F(t + M > jO| < Ke^yPh^ 2 . (36) 

Hence V is locally p/2-H61der with respect to t. 

6) Putting together all the information collected we get continuity of V on Rj_. 

Growth condition. Condition (|26|) is proved by combining (|32p. (|35p and (|25p . □ 
3.2 HJB equation: viscosity characterization of V 

By standard arguments of stochastic control (see e.g. [12^ Ch.4]), we can associate to V 
an HJB equation, which in this case reads as 

- v t + (/9 + X)v - XG[Hv] - sup H cv (y,Dr x „\v,D 2 x .v; c,n) = 0, (37) 

c>0,7reM 

where for (y, q, Q) G R + x R 2 x 52 (where 52 denotes the space of symmetric 2x2 matrices), 
c > 0, 7r G R, the function H cv is defined by 

H C v{y,q,Q]c,7i:) 

pb 0~ 0~ 2 TT 2 p 2 0~ 2 

= U{c) + (irb L - c)qi H yq 2 + -75— Qu + n 1 a lvQ 12 H ^- L 2/ 2 Q22- 

ciL 2 2 

Note that sup c>0i7re M H cv (y, q, Q; c, 7r) is finite if gi > 0, Qu < 0, in which case we have 

tt , n \ Tit \ ( &L ^! + P a LO-iyQi 2 ) 2 . pbho-i p 2 aj 2 
sup H cv {y,q,Q;c,ir) = U(qi) 1 yq2 + —^-yQ22- 

c>0, 7T6IR la L^ll ^ 

Let us denote by X = (x,y) vectors in M. 2 ^. We are going to prove that V is the unique 
constrained viscosity solution to (137p according to the following definition. 
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Definition 3.1 (1) Given v a continuous function on R^_, the parabolic superjet of v at 
(t, X) G R+ is defined by: 



P 1,2 ' + t5(*, X) = {(r, 9 ,Q)GlxR 2 x S 2 such that 

t>(a,X') < v(t,X)+r(s-t)+(q,X' - X) + ^ (Q(X' - X),X' - X) +o(\s - t\ + \X'-X\ 2 ) }, 

We define its closure V ' ' v(t,X) as the set of elements (r,q,Q) £ 1 x I 2 x 5 2 for 
which there exists a sequence (t m , X m , r m , q m , P m ) m of R% x V x > 2 > + v(t m ,X m ) satisfying 
(t m ,X m ,r m ,q m ,Q m ) ->■ (t,X,r,q,Q). We also define the subjets 

P 1 ' 2 '-^,*) = ^■^(-^(t.X), p 1,2 '~t;(t,X) = -p 1,2,+ (-«)(*,*). 

(2) We say that a continuous function £ is a viscosity subsolution (resp. supersolution) to 
(J37D at (i, X) G R3 if 

-r + (/3 + A)£(i,X)-AG[?{t)](t,X)- sup H cv (y,q,Q;c,ir) < 0, 

c>0,7reIR 

for all (r,q,Q) G p 1,2 ' + ?)(t, X) (resp. > , p 1,2 '"i)(t, X)). 

(3) We say that a continuous function v is a constrained viscosity solution to (|37p if it is a 
subsolution on a supersolution on [0, +oo) x (0, +oo) x IR + and satisfies the boundary 
condition 

r r°° i 
v(t,0,y) = E[J^ e^ (/3+A)( ^' ) AG[^0](s,0,y^)(isJ, Vt > 0, Vy > 0. (38) 

Remark 3.1 The concept of constrained viscosity solution we use naturally comes from 
the stochastic control problem. The boundaries {x = 0, y > 0} and {x > 0, y = 0} are 
both absorbing for the control problem (in the sense that starting from these boundaries, 
the trajectories of the control problem remain therein), but they have different features. 
Indeed starting from the boundary {x > 0, y = 0} the control problem degenerates in 
a one dimensional control problem; the associated HJB equation is nothing else but our 
HJB equation restricted to this boundary and this is why we require viscosity sub- and 
supersolution properties to the value function at this boundary. Instead starting from at 
the boundary {x = 0, y > 0} there is no control problem (since At(0) = {(0,0)}) and the 
natural condition to impose is a Dirichlet boundary condition. 

Theorem 3.1 V is the unique constrained viscosity solution to (|37p satisfying the growth 
condition (1261). 



Proof. The fact that V is a viscosity subsolution on M.+ and a viscosity supersolution on 
M + x (0,+oo) 2 is standard (see, e.g., [HI Ch. 4]). The Dirichlet boundary condition (|38|) 
is verified due to (|15p and (|24p . The growth condition (|26p has been already proved in 
Proposition 13.41 

Therefore, it remains to show that V is a supersolution when y = 0. In this case, the 
control problem degenerates in a one dimensional one and again standard arguments apply 
to this control problem, giving the viscosity supersolution property. 

Uniqueness is consequence of the comparison principle Proposition 13.51 below. □ 
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Proposition 3.5 Let wi (resp. W2) be a viscosity subsolution (resp. supersolution) to 
(|37p on x (0,oo) x R + . Assume that w\, W2 satisfy the growth condition (|26p . and the 
boundary condition 

/oo 
e -iP+^K»-*)XG[nwi](8,0 f Y^' v )da (39) 

(resp. > for W2). Then w\ < W2 on Rj_. 

Proof. Step 1. Starting from u>2, we construct a sequence of supersolutions (w 2 ,n)n>l 
that will be used in the next step to show the comparison. Fix some p' G (p, 1) such that 

/5 > V = irp^J + V- ( 4 °) 

Finding such a p' is possible by ([3]) and by the fact that p' \-t k p / is continuous. Define 

f p '(t,x,y) := eV*(x + yf'. 
We claim that on M + x (0, 00) x M + 

-/f + + -\G[nf p '}- sup H cv (y,D^ y) r',Dl ' x y) f p ' ;0,tt) > 0. (41) 

7T6M 

Indeed, first we observe that G\Hf p '} < / p by Proposition 13. 3f v). and then by straightfor- 
ward computations we can check that 



sup 

ttSR 



2^2 ^2 / l2 

— / 



l-p' 2a\ 

Hence, using (I40p we obtain (141 p . Now given an integer n > 1, consider the function 

^2,n := ^2 + -/ P '- 

n 

We claim that for any (t,x,y) G M + x (0,oo) x R + , the function is a supersolution to 
(f37P at (t,x,y). Indeed, notice that 

V 1 ^-w 2 ,n(t, x, V) = V l ^-w 2 (t, *, y) + -(ff,D (Xiy) fP',Df x v) r')(t, x, y). 



n 



So, using subadditivity of H, linearity of G, the fact that fx > 0, linearity of H cv in (q, Q) 
and (gH), we have for all (r,q,Q) G V l > 2 '~ w 2 {t,x,y) 

-(5 + -/f'(*, V)) + (0 + A)(t&2(t, s, y) + -/ p '(t, y)) - AG[ft(u> 2 + -/ p ')](t, y) 
n n n 

- sup H cv (y, q+ -D {xy) f p '(t,x,y), Q + -Df } / p '(t,x,y); c,vr) 

c>0,7reM " " 

> -g + (0 + X)w 2 (t,x,y) - XG[Hw 2 ](t,x,y) - sup H cv (y,q,Q;c, vr) 

c>0,7reM 

+ 1 { - /f'(i,x,2/) + ( / 9 + X)f p '(t,x,y) - XG[nf p '](t,x : y) 
-supH cv (y, D {Xjy) f p '(t,x,y), Dl J p ' (t,x,y); 0,vr)} > 0. 
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This shows that actually W2n is a supersolution to ([37|) at (t, 7/) for each n > 1. Moreover, 

/"OO _ /"OO 

AE / e-^+^^G^/P']^^,^)^ < eVy'AE/ e (-^ A+ V)( s -*)(y^ 1 f'd s 

/■oo 

< f p '(t,0,y)X / e (-^- A +V)( s -*)d s 



/8 - Ay + A 
< / p '(t,0,y), 



/ p '(i,0,y) 



where in the second inequality we have used (|22p . By subadditivity of H and linearity of 
G, it follows that 

/oo 
e -(H^'-t)xG[Hvh, n ](s,0,y^' v )ds. (42) 

Finally, notice that by the growth condition on w\ and W2 we have 

lim (wi-w 2 ,n){t,x,y) = -00. (43) 

\(t,x,y)\-*oo 

Step 2. We show that for all n > 1, it is u>i < u^n on and thus conclude that 
w\ < ui2- Fix n > 1 and define 

M := SUp (u)i - W2,n)- 

[0,+oo)xR2 



We want to show that M < 0. By (j43J) and continuity of wi,W2,n> we see that, for some 
To > 0, C a compact subset of M+, and (t,x,y) € [0,To] x C, 

M = max (u>i - u>2,n) = (wi - w 2 , n )(i,x,y). (44) 
[0,T ]xC 2 

We now distinguish between two cases, showing that both of them lead to conclude M < 0. 

Case 1: x = 0. First note that Hw\ — %u>2,n. < M. Using the boundary condition ([39]) . we 
then have 

M = (wi - w 2 ,n)(t,0,y) 

< E j_ e-^ +x ^ s -^\G[Uwi-Uw2, n ]{s^y^)ds 

poo 

< / e -^ +x ^ s -^\Mds 

- 

and it follows that M < 0. 

Case x > 0. Using viscosity properties of w\ and W2 !n , the nonnegativity of an interior 
maximum may be proved by the "doubling of variables" technique as in [2]. 
Define on [0, To] x C 2 the function 

* e (t,x,x') = Mt,x) - w 2 , n {t,x') - |x ~ £ x/|2 . 
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Since $ e is continuous on the compact set [0, To] x C 2 , there exists (t £ ,X £ ,X' E ) such that 

M £ := sup $> £ = <f> £ (t £: X £ ,X' £ ), 
[0,T ]x(C)2 

and a subsequence, still denoted (t £ , X £ , X' £ ), converging to some (t,X, X'). By standard 
arguments (see e.g. Lemma 3.1 in [2]), we have 



Mm |X '- X -' 2 

e->-o 2e 



0. 



(45) 



from which follows that X = X' and consequently that (t, X) is a maximum point of 
— ^2,n)- Hence, without loss of generality we can take in ()44p 



(t,x,y) = (£JT). 

Now we apply the parabolic Ishii lemma (Th. 8.3 in [2]) to obtain r,r' G K, in 5 2 

such that 



x £ -X 



r', Xe £ X ' £ ,Q') 



Q \ < 3 
-Q' j - e 



h -h 
-h h 



(47) 



r + r 



0. 



(48) 



Since X £ converges to X, we have X £ > for e small enough, and we can use the viscosity 
subsolution property of w\ to obtain 



r+(/3 + A)u)i(i £ ,X £ )-£/ 



AG[%u>i](i £ ,x £ ,y £ ) 



sup 

vreM 



7T- 



x £ - 4 p6 L o-/ y £ -y' £ , o-|7T 2 



+ 



y £ 



e 2 
and the supersolution property of W2, n to get 

-/ + (/? + \)w 2 ,n{te, X' £ ) -U 



+■ -7T— + npa I cr L y £ Qi2 + p 2 ^-y £ Q 



22 



AG["Hw2,n](i £ ,a;^ye) 



sup 

ttSIR 



7T 



x £ - x' £ pbfj&j l y £ -y' £ ct 2 l tt 2 , 



.cr. 



OL £ 2 2 



(49) 
< 0, 



(50) 
> 0. 



Subtracting (|49p from (|50p . using the fact that the difference of the supremum is less than 
the supremum of the difference and (|48p . we obtain 



^ + A)(w)i(i £ ,X £ )-^ 2)ri (t e ,X^)) 



< sup 

ttGIR 



2^2 



L ^(Qn - Q'u) + Kpviv L (yeQi2 - y'eQ'12) + p 2 y(y £ Q22 - G/ £ ) V 22 ) 

p6 L a7 (y £ -y £ ) 2 + A ( G[nibl] ( teiXe) _ G[n u %n }(t £ ,X' £ )) . 

(T£j S 



(51) 
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Now notice that 



lim (G[Hwi]{t £ ,X £ ) - G[Hw 2 ,n](t s ,X' £ )) = G[mh](i,X) - G[Uw 2 , n ](t, X) 

< SUp(?iWi - 7iW2,n) 

< M. 



(52) 



Furthermore, using (|47p we see that for all tt G R 

2 2 2 

^(Qn - Qii) + 7rpa 7( 7 L (j/ £ Q 12 - ^Q' 12 ) + p 2 ^-(y 2 e Q 2 2 - 



- [ a L TT paiy e a L n poiy e 



< (/^) 2 ^ £ -^| 2 . 



Q 
-Q' 



1 2 -h 
-h h 



pern 

a L ir 

( OL^ \ 



pom 

a L TT 

V P a iy'e j 



Recall that by (jl5 



— > when e — >• 0. 



(53) 



(54) 



Letting e go to in (|5T|) . and combining (|52|) - (|53|) - (|54|) . we finally obtain 

(/3 + A)M < AM, 

so M < 0. 



□ 



4 An iterative approximation scheme for the value functions 

In this section we present an iterative scheme to compute numerical approximations of the 
value functions V and V. For sake of brevity we omit the proofs of the results that can be 
found in [6]. 

First of all, we observe that (|37p contains a nonlocal term, i.e. GfT^V]. Thus, in order 
to get a computational tool to approximate V and V, it is needed to couple standard 
numerical schemes with an iterative procedure as we are going to describe. 

We start with 

V° = 0. (55) 

Then, inductively: 
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Given n > and V n , we define V n on K.^_ as the unique (constrained viscosity) 
solution to 



-V t n + {p + \)V n -\G[V n ]- sup H cv (y,D^ y) V n ,Dt ,^-,€,71) = 0, (56) 

c>0,7reK 

with boundary condition 

e-^ +A ^ s -*)AG[F n ](s,0,Y s t ' 2/ )ds. (57) 

and growth condition 

\V n {t,x,y)\ < Ke^\x + y) p . (58) 

- Given n > and V n , we define V n+1 by 

We have a stochastic control representation for (V n ,V n ) n >o : 
Proposition 4.1 For eac/i n >0 we have 

f-T n 

V n (r) = sup E / e- pt U(c 3 )ds, (60) 

(c,7r,a)€„4(r-) Jo 

and 

V n (t,x,y) = sup E [°° e-V+M'-t) (u(c s ) + \G[V n ] (s, X^^'^Y^)) ds. (61) 

(c,7r)eA(x) ^ V V yy 

The next result states the convergence of V n to V at an exponential rate. 
Proposition 4.2 For some K > 0, toe /lave 

< (V -V n ){r) < Kr p 5 n , (62) 
< (V -V n )(t,x,y) < Ke^ t {x + y) p 8 n , (63) 

where 

5 A 

A + /3 - fc p 

To solve the PDE (|56[) one needs to approximate it by a finite horizon PDE. To this end, 
we fix some finite horizon T > and consider the functions V n,T , V n,T defined recursively 
as follows: 

- V^ T = 0. 
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Given n > and V n,T , and given some terminal boundary condition condition 4> n,T 
we define on [0, T] x R\ 

r /-t 

F n ' T (t,x,y) = sup E 



(c,7r)eA(x) 



/•T 

^ T (i,0 )2/ ) = E 



e 



e -(/3+A)(,-t) (jj^ + AG [yn,T] ^ X^' , Y?'*)) (is 
+e -^+A)(T-t)^n,T ( ^,x |W ,C ) jK tf) j ; 

- Given re > and l/ n,T we define 

F n+1,T = n yn,T 

By the same methods as above it is then straightforward to check that, for each n > 0, 
V n ' T is a constrained viscosity solution on [0, T) x IR^ to 

-V t n > T + (f3 + X)V n ' T -XG[V n ' T ](t,x,y)- sup H cv (y, D (x , y) V n ' T , Df ' x>y) V n > T ; c, tc) = 0, 

c>0,7rSM 

with boundary conditions 

\G[V n ' T ](s, 0, Y?'*)da + e -O»+ A )( T -*)0 n . T (O J Y*' x ' n ' c ) 

Now we assume that the terminal condition cj) n,T satisfies 

^ T (x,y)-V n (T,x,y)\ < £e^ T {x + yY, 

for some error £ not depending on re. Note that this assumption is not restrictive since 
< V n < V, and so due to (j26]) . the inequality (f64"|) is satisfied, e.g., by taking (f> n ' T = 0. 

We then have the following estimate for the numerical error induced by the finite horizon 
approximation: 

Proposition 4.3 For every re > 1 and every t E [0, T], r, x, y G ~R + , 

\f V n,T_yn^ < _J_ ^(^A-fc^ 

1 — 

\(V n ' T -V n )(t,x,y)\ < _L e -(^W T e V( x + y )P. 

l — o 

By combining Propositions 14.21 and 14.31 one can choose re, T large enough to approximate 
V, V by F n ' T , y n - T (respectively) with any required precision. The latter ones can be 
computed by the iterative procedure described above, using at each step of the iteration 
a standard explicit finite-difference scheme for parabolic viscosity solutions to solve the 
PDE (see e.g. chapter IX in [3] for a description of the scheme, as well as the proof of its 
convergence). Finally, we observe that the choice of re and T has to depend on A: 

- When A is large, 5 is close to 1 so that the number of iterations n must be chosen 
large. 

- The finite horizon error is roughly speaking of order (1 + X)e~^ 1+ ^ T , so that T may 
be chosen small for large A and must be reasonably large for small A. 
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5 Cost of illiquidity and optimal policy in the illiquid asset 



The results obtained allow us to measure the cost of illiquidity and to determine the optimal 
policy allocation in the illiquid asset. Indeed, V can be computed numerically following 
the scheme described in Section 4, and then the optimal allocation {a* k )k>o in the illiquid 
asset and the value function V can be derived. 

At To = the optimal allocation in the illiquid asset is 

a* = argmax < a < r V{0,r - a, a). 

and consequently the value function V can be computed. 

Figure [1] shows the impact of illiquidity in the case of power utility U{c) = c p /p. In 
this case, by standard arguments using the homogeneity of U, one can prove that the value 
function has the structure V(r) = V(l)r p . The value V(l) is represented in Figure CD as 
function of p for different values of the liquidity parameter A. The lines corresponding 
to the constrained and unconstrained Merton refer to the problem when the asset I is 
considered as liquid and when, respectively, the constraint ttj £ [0, 1] is imposed or not. 
The parameters are set as follows: 

= 0.2, p = 0.5, & L = 0.15, <j l = 1, 6 7 = 0.2, <rj = 1. 

We observe, as expected, a monotone convergence to the constrained Merton problem (see 
also [1] for comments). The difference between the different values of A can be taken as an 
absolute measure of the cost of illiquidity. 



A = 1 A = 50 

A = 5 - constr. Merton - 

A = 10 unconstr. Merton — 



Figure 1: Value function V(l) as a function of p, for various A. 
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In Figure [2] we plot the optimal investment proportion in the illiquid asset chq/v as a 
function of the correlation p, for various values of the liquidity parameter A. Also in this 
case we observe the monotone convergence to the constrained Merton problem. 
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Figure 2: Optimal investment proportion a^/r in the illiquid asset as function of p for various A. 
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